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The Work Performance Assessment (WPA) is a brief work 
simulation designed to evaluate job maintenance skills, emphasizing 
work-related social/interpersonal skills rather th-.u specific 
vocational skills. The WPA uses three work samples involving sorting 
of food tr>rvice items to measure 19 common work demand?? in four 
categories: responding to supervision, completing job tasks, 
cooperating with other workers, and socializing on the 30b. The 19 
demand.-; are presented by a supervisor to 2 trainees and require 1 
hour to administer. The WPA may be scored by completing either; (1) 
an 83-item behavior rating form which calculates the proportion of 
behavioral criteria demonstrated in responding to the 19 work 
demands; or (2) the Work Personality Profile which provides a profile 
of employability strengths and limitations on 58 behaviors. The 
manual includes results of reliability/validity studies, the WPA 
script and rating form, a work break rating form, and 21 references. 
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Overview 

***The Work Performance Assessment (WPA) is an efficient 
alternative to multi-week situational assessment methods. 

***Using three work samples (sorting food service items), 
the WPA measures trainee responses to 19 common work 
demands in f?our categories: responding to supervision, 
completing job tasks, cooperating with other workers, and 
socializing on the job. 

***Requiring one hour to administer, the 19 WPA demands are 
presented by a supervisor (evaluator) to two trainees. 

***The WPA may be scored by completing either (a) an 83 item 
behavior rating form or (b) the Work Personality Profile 
(now available on computer disk from the Arkansas 
Research and Training Center in Vocational Rehabilitation) 

***The WPP provides a profile of employabili ty strengths and 
limitations on 58 behaviors which can be rated following 
administration of the WPA. 

***When the WPA rating form is used, a total score is 
generated by calculating the proportion of behavioral 
criteria demonstrated in responding to the 9 work 
demands . 

***Interrater reliability of the WPA rating form is accep- 
table, although multiple ratings/administrations are 
recommended for the most reliable performance estimate. 

***Research indicates the presence of administrator effects 
on WPA scores which underscores the need for careful 
administrator training. 

***The WPA discriminated between adjustment and work ready 
clients in a facility serving individuals with traumatic 
brain injury. Similar validity results were not obtained 
in a study conducted at a large rehabilitation center. 



Evaluators should complete a brief WPA orientation session 
conducted by the Arkansas Research and Training Center in 
Vocational Rehabilitation. Contact Roy Farley, Director 
of Training (501/624-4411), for additional information: 
Arkansas Research & Training Center, Hot Springs Rehabil- 
itation Center, P.O. Box 1358, Hot Springs, AR 71902. 
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Manual for the Work Performance Assessment 
Introduction 

Making an appropriate vocational choice, acquiring the 
requisite technical skills, and mastering job seeking 
demands are major accomplishments. But, these achievements 
also lay the groundwork for yet another challenge, that of 
maintaining employment. Data from employer surveys (Wilms, 
1984) and from employment specialists (Herr, 1984) indicate 
that job failure is often the result of inability to respond 
to supervision and to other interpersonal demands in the 
workplace. In fact, employers stress their needs for entry 
level workers who possess fundamental job maintenance skills 
such as the abilities to work hard and follow rules (Wilms, 
1984) . 

Because long-term employment is a function of problem- 
solving skills, adaptability to environmental demands, posi- 
tive work habits, and interpersonal skills, assessment tools 
are needed which indicate the extent to which rehabilitation 
clients possess these job maintenance skills (Eleventh 
Institute on Rehabilitation Issues, 1984). Such measures 
have both screening and diagnostic uses. For example, indi- 
viduals demonstrating job maintenance capdbili ties (Roessler 
& Bolton, 1983) should be recommended for vocational 
training and placement, while persons with employabili ty 
deficits require a variety of work adjustment services. 

The job maintenance skills of specific interest include 
task related and interpersonal elements of work behavior 
(Neff, 1986; Roessler & Bolton, 1983) falling into four 
categories: dealing with supervision, cooperating with co- 
workers, completing task assignments, and socializing on the 
job. In the past, situational assessment has been used to 
evaluate client strengths and weaknesses in such areas. 
Using the situational assessment approach, rehabilitation 
professionals observe client responses to job demands in on- 
the-job evaluation or work contract job stations. Involving 
significant investments of time, effort, and money, 
situational assessment is an approach for which more cost 
effective alternatives should be sought. One feasible 
alternative to situational assessment is the Work 
Performance Assessment (WPA) , a brief work simulation 
designed to evaluate job maintenance skills. 

The Work Performance Assessment (WPA) 

WPA demands . Although similar tc a traditional work 
sample in appearance (sorting food service items), the WPA 
assesses work-related social/interpersonal skills rather 
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than specific vocational skills. One WPA evaluator can 
issess two trainees simultaneously. Each trainee receives a 
WPA total score (the proportion of 83 behavioral criteria 
demonstrated) which represents an estimate of the indivi- 
dual's employibility based on his/her responses to 19 job 
demands. Listed in Figure 1, these 19 job demands represent 
common on-the-job situations which fall into four catCi- 
gories: responding to supervision, completing job tasks, 
cooperating with other workers, and socializing on the job. 

WPA script . Introduced in the context of sorting food 
service items, the 19 WPA demands must be delivered in a 
manner consistent with that of a work supervisor. To 
increase the probability of such a delivery, a WPk script 
(see Appendix A) was developed to provide instructions for 
administering each of the 19 conditions. The WPA script 
specifies the demand involved, the dialog required to 
deliver the demand, special instructions and/or materials, 
and the behavioral criteria to be rated. Samples from the 
script for two demands — show a new way to work and introduce 
time pressure — are presented in Figures 2 and 3. 

Tho WPA evaluator creates the demand such as "show a 
new way to work" by speaking the scripted dialog in the 
style or demeanor indicated. Specific instructions are pro- 
vided regarding material to use and time to wait before 
moving to the next demand. To ensure uniformity in admi- 
nistration c: the WPA, evaluators must follow the script and 
instructions carefully. 

WPA scorin g. Alternative scoring schemes for the WPA 
are availa>~le. Using the WPA Rating Form (see Appendix A), 
the evaluator rates each trainee for the presence or absence 
of a series of behavioral criteria following the presen- 
tation of each work demand. For example, after greeting the 
trainees (demand 1), the evaluator rates each trainee on the 
following: 

1. Makes eye contact 

2. Returns greeting (says "hello," "good morning/ 
afternoon" ) 

3. Responds to administrator's inquiry (states how 
trainee is doing) 

4. Asks administrator a greeting related question 

The ratings for two other demands, "show a new way to work" 
and "introduce time pressure", are also presented in Figures 
2 and 3.. 

As noted in Figure 3, ratings for the time pressure 
demand include "speeds up work pace" and "works without 



Figure 1 

Niiieteen Job Demands Presented in the WPA 
Greet each trainee 

Direct trainees to work station and explain nature 
of work 

Provide vague instructions 

Explain supervisory error 

Provide detailed instructions 

Observe trainees working 

Stand next to trainee 

Create a distraction 

Show new way to work 

Introduce time pressure 

Criticize trainee's work 

Compliment trainee's work 

Ask trainees to switch tasks 

Ask trainees to socialize 

Direct trainees to work togetner 

Ask trainees to criticize ^ ..jh other 

Ask trainees to complime^vc each other 

Observe trainees: npleting the task togetnei. 

Socialize with ecich trainee 
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Figure 2 



Administering WPA Demands 

Demand 

Show a new way to work 
Demeanor 

Make eye contact; maintain neutral voice tone and 
matter-of-fact manner. 

Dialog 

To Tr-1: I want you to work a little di*^ cerently for 

the next 5 minutes. Instead of sorting all of the out of 

the bag before starting on the other items, try this and see 
if it goes faster. Reach into the bag and pick up any item, 
no matter what it is, and put it directly onto the right 

tray. If you pick out a , go ahead and place it on a 

tray. If you pick out a , place it directly on the 

correct tray and don't worry about whether there ^ire still 
or in the bag. 

To Tr-2; See if yuu can't get more sorted during the 
next 5 minutes by changing ho^' you work. What I want you to 
do is pick any item out of the bag and place it directly 

onto the correct tray. Don't wait to get all of the out 

of the bag before starting on the other items. If you pick 

up a 9 just put it on thp tray. If you pick up a , go 

ahead and sort it onto the tray ev^n if you still have 

left in the bag. 

Directions 

Demonstrate, using one each of the second and third 
items to be sorted. After rating, wait 1 minute before 
going on to the next demand. 

Ratings • Tr-1 a'r-2 

Makes eye contact 

Verbalizes understanding of new work method 

Changes work method when instructed 

Resumes work without becoming upset 

Works without prompting or excessive ques- 
tioning or complaining 



Figure 3 



Administering WPA Demands 

Demand 

Introduce time pressure. 
Demeanor 

Make eye contact; manner and voice tone should have a 
tinge of urgency to them — but avoid being punitive. 

Dialog 

To Tr-1: You've now worked 2 minutes, and altogether 
you only have about (estimate %) of the items sorted. You 
have just 3 more minutes to work on this part of the job, so 
you need to pick up your pace. 

To Tr-2: I see you have sorted only about (estimate %) 
of the items in your baq. You've already iieen working 2 
minutes, so you only have 3 more minutes on this job. You 
need to speed up. 

Directions 

After rating, wait 1 minute before going on to next 
demand. 

Ratings Tr-1 Tr-2 

Speeds up work pace 

Works without arguing or becoming upset 



arguing or becoming upset." The^n ratings can be made imme- 
diately in the assessment situation (in vivo) or later from 
a ^^ideotaped recording. Research with the WPA, discussed in 
a later section, indicates that either method of scoring is 
acceptable. Of course, scoring from a videotape at a later 
time places less pressure on the evaluator. To enhance the 
reliability of the WPA, additional staff members can rate 
videotaped trainee performance on several WPA components. 

A total of 83 behavioral criteria are rated in response 
to all 19 demands, resulting in a summary score ranging from 
0 to 83. This summary score is converted to a proportion/ 
percent of criteria demonstrated (divide number of behaviors 
present by 83) which represents an overall level of job 
maintenance skills. Deficiencies on any of the 83 criteria 
represent objectives for work adjustment planning. Raters 
also complete a WPA Work Break Rating Form which includes 
several style criteria and a comment section for listing 
additional employabili ty assets and limitations. 

Following administration of the WPA, evaluators may 
prefer to complete the Work Personality Profile (WPP; Bolton 
& Roessler, 1986) for each trainee rather than the WPA 
rating form. Scored on computer diskette, the WPP is a 58 
item beh?v' or checklist designed to measure job maintenance 
skills. Although the WPP does not provide as much beha- 
vioral specificity as the WPA rating form, it has adequate 
detail for the development of specific work adjustment 
ob:;ectives. Depending on the specificity of rating desired, 
the evaluator, therefore, has two scoring schemes to choose 
from: (a) the WPA Rating Form, the Work Break Rating Form, 
and the employabili ty comment section or (b) the 58 items of 
the Work Personality Profile. 

Developme n t of the WPA. Based on a review of existing 
employability instrumentation and literature, social/ 
interpersonal elements of job-keeping behavior were selected 
for measurement in the WPA (Mathews, whang, & Fawcett, 1980; 
Roessler & Bolton, 1983; Roessler & Bolton, 1985). Specific 
behaviors associated with several broad categories of job 
keeping--Task performance. Teamwork, Supervision, and 
Socializing on the job — were enumerated and analyzed in 
terms of the situational demands requirerl if clients were to 
demonstrate those behaviors. For example, to evaluate 
client willingness to change task performance, the situation 
would have to include the provision of new instructions. To 
evaluate appropriateness of client requests for supervisory 
assistance, the situation must preaent incorrect or 
incomplete task instructions or materials. 
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The 19 WPA demands occur during an ongoing work sample 
that requires individuals to sort common food service items. 
Because they are analogue methods (i.e., staged versions of 
real-life settings), simulations such as the WPA are 
generally regarded as "second best" methods (Bellack/ 
Hersen, & Lamparski, 1979). Nevertheless, with proper deve- 
lopment, simulations have the potential for cost effective 
assessment of job maintenance skills (Haynes, 1978). For 
example, the WPA is presented as a real work situation in 
^hich the trainee is to respond as if the administrator were 
a job supervisor. Because the administrator has a detailed 
script to follow during the simulation, he or she also 
enhances the validity of the assessment by presenting the 
stimuli which elicit the beha^'iors of interest (Haynes, 
1978; Kelly, 1982) . 

Due to participant reactivity to the measurement 
situation (Haynes, 1978), results of analogue studies must 
be interpreted with caution. For example, the person may 
persist at tasks because it is expected (Bellack 6f Morrison, 
1982) or perform at optimal levels because artificial con- 
sequences for the behaviors are operating (Goldfried, 1982; 
Higgins, Aloriso, & Pendleton, 1979)- Even with such limi- 
tations, simulations remain a valuable measurement tech- 
nique. 

WPA Ma te rials and Admin is tratio n 

Work sample m a terials . The WPA consists of three 
parallel work samples which enable the administrator to pre- 
sent the critical lob maintenance demands. Each of the 
three WPA work samples includes two tasks, each followed by 
a simulated work break with either a supervisor or with a 
co-worker. Although many materials may be selected for 
sorting, the original WPA research was conducted with food 
service items. For example, WPA Component I uses stir 
sticks (3 types), wet napkins, coffee creamers, and salt 
packSe WPA Component II requires plastic knives^ forks and 
spoons, plates, pie sleeves, and french fry sacks. Sugar, 
artificial sweetener, pepper packs, and a variety of cup 
lids are sorted in WPA Component III. The materials used in 
each of the WPA components are described in Figure 4. 

Three WPA components (I, II, III) were developed to 
meet the assessment requirements of Vocational Coping 
Training (VCT; Roessler & Johnson, 1987), the intervention 
designed to teach the job maintenance behaviors assessed by 
the WPA* VCT requires three parallel evaluations of the 
individual's employability assets and limitations — a pre- 
test, a posttest, and a follow-up assessment<> Of course, 
the WPA can be used independently of Vocational Coping 
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Figure 4 



WPA Components and Materials 

WPA Component I 

Trainee 1 Trainee 2 

I ncomplete materials ; sorting Incomplete materials ; 

wooden and pink plastic stir sorting wet napkins and 

sticks (100 each) coffee creamers (100 each) 

Complete materials ; sorting Complete material s; sort- 

coffee stir sticks (3 types; ing salt packs, wet 

wooden, pink plastic, clear napkins, and coffee 

plastic, 500 each) creamers (300 each) 

Work brea k with c o-worker 
Teamwork task 

Sorting pink plastic and wooden stir sticks and salt packs 



(150 each) 
WPA Comoonent II 



Work break v<ith supervisor 



Trainee 1 Trainee 2 

Incomplete materia ls; sort- Incomp l ete materials ; 

ing plastic knives and forks sorting plates and 

(100 each) pie sleeves (100 ea.) 

Complett; materials ; sorting Complete materials ; 

plastic knives, forks, and sorting plates, pie 

spoons (500 each) sleeves and french fry 

sacks (500 each) 
Work break with co-worker 
Te amwork task 

Sorting plates, pie sleeves, and plastic spoons (150 each) 

Work break with supervisor 

WPA Component III 

Trainee 1 Trainee 2 

Incomplete materials : sorting I ncomplete materials ; 

sugar and artificial sweetener orting small & medium 

packs (100 each) cup lids (100 each) 

Complete materials ; sorting Complete materials ; 

sugar packs, artificial sorting small, medium 

sweetener packs, and pepper and large cup lids 

packs (500 each) (500 each) 

Work break with co-worker 
Teamwork t ask 

Sorting sweetener packs, pepper packs and small cup lids 

Work break with supervisor 
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Training to evaluate the individual's job maintenance skills 
both before and after work adjustment interventions. 

Two types of work tasks are include'^ within each WPA 
componeiit to minimize the possibilities o£ trainees receiving 
cues f'rom each other and to provide an opportunity for the 
supervisor to request that each trainee change jobs. The 
work tasks (sorting food service items) address the critical 
job maintenance behaviors involved in work performance. 
Important socializing skills are also assessed in each of 
the work breaks. The evaluatot' should keep in mind tne dif- 
ference in the status of the two partners available to the 
trainee in each of the socializing simulations, i.e., the 
supervisor and a co-worker. 

Administration considerations . If possible, the eva- 
luator should wear a portable microphone in order to record 
verbal data important to the WPA. If videotaping tne WPA, 
the administrator should not stand between the camera and 
the trainees who are 1 sing filmed. After the trainees begin 
their tasks, the supervisor (evaluator) should become busy 
in another part of the room, returning to the actual work 
station only if summoned or if it is time to present a new 
stimulus condition (demand). The administrator needs a 
stopwatch to monitor time. 

The administrator must stress that the WPA is a simula- 
tion of an actual work situation with the administrator 
playing the role of the supervisor and the trainee playing 
the role of a new employee. Once the WPA session begins, 
the evaluator should require the trainees to stay in their 
roles as workers. To encourage such role taking, the eva- 
luator should first explain the nature of the assessment to 
both trainees before they enter the area in which the WPA is 
to be conducted. As soon as the trainees enter the actual 
work area, they should assume their proper roles. Before 
each WPA session (I-III), the WPA administrator should 
discuss the following points with the trainees: 

1. The WPA is a measure of your typical work style in 
several different work activities. 

2. Act as if you are a new employee on the job. 

3. Assume that you are an hourly employee being p.;: a 
slightly more than minimum wage. 

4. I am your work supervisor; treat me just as you 
would if you wert. actually on a job. 

5. We are now ready to begin. Do you have any 
questions? 

6c The WPA will be conducted in that area of the 

building. At this time, please move to the work 
area. I will enter the work area, greet each of 



you, and explain the day's work to you. From that 
point on in the assessment, I will answer only 
those questions appropriate for a work supervisor. 



The evaluator should set up a work break area in which 
to administer the WPA. Looking as much like a work station 
as possible, this area should be separate from the place in 
which the evaluator first orients the trainees to the WPA 
assessment. The evaluator may need to reorient trainees to 
their roles periodically during the WPA. In delivering work 
demands, the administrator should act like a work super- 
visor, e.g., the evaluator should be serious, businer^s-like, 
and brief in his/her interactions with the trainees. 

Precautions . Proper use of the WPA requires attention 
to the following precautions: 



1. Absence of a problem during the WPA assessment does 
not mean that the problem does not exist. The eva- 
luator should continue to observe the individuals' 
job maintenance behaviors throughout their tenure 
in the program. The WPA is only one sample of the 
person's employabili ty behavior. 

2. Job maintenance strengths and limitations should be 
described in specific behavioral terms. The eva- 
luator should avoid statements such as "motivated" 
worker or "lazy" trainee; behavioral descriptions 
are recommended, e.g., "stays on task", 
"acknowledges own mistakes", "shouts at 
co-workers", or "begins work without understanding 
the ♦■.ask. " 

3. WPA assessment should be followed by systematic 
interventions to help trainees develop needed 
employability skills, e.g.. Vocational Coping 
Training (Roessler & Johnson, in press), behavior 
management strategies (Marr & Roessler, 1986), or 
Conversation Skills Training (Lewis & Roessler, 
1984). Trainees must understand how their 
strengths help them secure and maintain work and 
how their limitations interfere with their chances 
to get or keep a job. 

4. Trainees must have ample time to practice their new 
skills. They will need considerable didactic 
instruction, modeling, role playing, corrective 
feedback, and reinforcement to reach their maximal 
levels of functioning. 

5. Toward the end of the person's work adjustment 
program, the evaluator should review the typical 
demands of the work role with the trainee. Special 
emphasis should be placed on explaining to the 
trainee how his or her newly developed skills apply 
to a wide range of work situations. 
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6. Before exiting their work adjustment training 

programs, trainees should participate in a final 
WPA session. The evaluator and client should 
review employability assets and discuss changes 
needed to overcome remaining deficiencies. 

Reliability and Validity 

Two reliability and validity studies were conducted 
with the WPA. Implemented at the Hot Springs Rehabilitation 
Center (HSRC; Hot Springs, AR), the first study (see 
Appendix B for details) examined the reliability of in vivo 
and videotape rati .gs on the WPA as well as the WPA' s vali- 
dity. Participants in the study were clients at the Hot 
Springs Rehabilitation Center. Conducted at Timber Ridge 
Ranch (Benton, AR), a program serving individuals with 
traumatic brain injury (TBI), the second study (see Appendix 
C for details) also addressed reliability and validity 
questions. 

Based on a sample of T 4 clients, results from Study 1 
(HSRC) provided support for the scorer reliability of l:he 
WPA. When data from multiple raters and components were 
analyzed, learning effect (the order in which WPA components 
were administered) was minimal, and parallel form reliabi- 
lity approached an acceptable level. However, additional 
refinement of the WPA is needed to decrease effects of these 
two factors on WPA scores. Evaluator differences were also 
noted with one administrator's ratings being significantly 
higher than those of another rater. WPA scores failed to 
discriminate between clients assigned directly to vocational 
training and those recommended for work adjustment. 
However, several problems with the validity criterion are 
noted in Appendix B, e.g., failure of the criterion to 
relate to other work adjustment measures (Roessler & Boone, 
1982) or to center completion (Cook & Brookings, 1980). 

In the second study conducted with 24 TBI clients, 
acceptable interjudge agreement and parallel form reliabi- 
lity were found. Learning had no effect on WPA performance, 
although administrator differences were noted. Validity 
evidence was supportive; the job placement group 
demonstrated consistently better job maintenance skills 
(higher WPA proportion scores) than did the work adjustment 
group. 

While supportive of the concept of a work simulation 
measure of job retention, conclusions from the two studies 
underscore the need for further developmental research 
with the WPA. Evaluators using the WPA are reminded that 
the scorer reliability of the measure can be enhanced by 
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having additional staff rate videotaped performance. 
Indeed, for the most generalizable score, multiple ratings 
of performance on multiple WPA components are suggested. 
Both studies indicated the need for careful training of WPA 
administrators/raters. The two studies oroduced equivocal 
validity evidence for the WPA; hence, additional validity 
research is needed. 

Conclusions 

When data from multiple raters and administrators are 
considered, . the WPA has acceptabl^s scorer reliability. The 
most reliable composite scores occur by averaging multiple 
ratings from multiple WPA administrations (in vivo and tape 
ratings). VJith the provision that multiple raters are 
involved, it appears that WPA I, TI, and III have the poten- 
tial to identify individuals needing specific work adjust- 
ment services. Administrator effects noted in the two 
studies must be addressed by more thorough training in 
recognition of WPA behaviors and uniform administration of 
the WPA conditions. Additional validity evidence is needed, 
particularly from predictive validity studies which show 
that the WPA can identify rehabilitation clients who will be 
successful in retaining work. The Research and Training 
Center wishes to collaborate with agencies interested in 
conducting further research with the WPA. 
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Introduction to WPA Trainees 



Before we begin today, let me tell you about what you 
will be doing. You will be working with the WPA (Work 
Performance Assessment), which is a m^sasure of the way 
people work when given different iobs to do. As you perform 
the different work activities, please observe the following 
rules: 

1. Act as if you are a new employee on the job. 

2. Pretend that you are an hourly employee being paid 
for the jobs you are asked to do. 

3. Pretend I am your supervisor? treat me just as you 
would if you were actually on a job. 

Do you have any questions? We are now ready to begin. 
You are a worker and I am your supervisor. Our job is in 
the next room. (ADMINISTRATOR OPENS DOOR TO ROOM AND SAYS:) 
At this time, I would like both of you to go to the work 
area (point to the work area). I will joiii you there, greet 
each of you, and explain the day's work to you. From that 
point on, I will answer only those questions that are 
appropriate for a work supervisor. Remember to stay in your 
role as a worker; and I will stay in my role as your super- 
visor. 
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WPA Script 



Directions ; F-./iiow the scripted material (demand/demeanor and 
dialog/directions) to present each of the 19 WPA work demands. 
Remember to assume the role of a work supervisor and to present 
the demands in a similar style to each trainee. Stress how 
important it is that trainees remain in the role of workers 
throughout the assessment. The trainees may work at the same 
table, but not side-by-uide until the teamwork task. 



Demand/Demeanor 

1, Greet each trainee 
(Tr-1, Tr-2) 
Smile; act friendly 
and interested; 
look at each 
trainee during 
greeting . 



2. 



3. 



Direct trainees to 
work statio n and 
explain source of 
work 
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Dialog/Directions 

To both: "Good morning/afternoon." 
(wait briefly for reply) 

To Tr-1: "How are you^ ?" 

(v;ait briefly for reply^ 

To Tr-2: "And, , how are you 

doing?" 

(wait br..efly for reply) 

To both: "Let me show you to your work 
station. Come over here to this table 
and have a seat. We have some large 
contracts with several fast food 
restaurants. One of our jobs is to 
sort food service items that get mixed 
ap during rush hours when busy 
employees are hurrying to fill orders 
as fast as they can. That is what both 
of you will be working on this 
morning/afternoon." (Turn away to 
pick up bags containing items to be 
sorted, which are needed for the next 
demand. For this task, one of the 
sorting items should be missing from 
the bags given to each trainee. 

To Tr-1: "In this bag are some food 
service items that are mixed up (place 
bag beside Tr-1). Your task is to sort 

the items out so that all the s are 

together, all the s are together, 

and all the s, are together.* Go 

ahead and begin nov;." 
To Tr-2: "This is your bag of 
materials. You are to sort out these 
food service items (place bag beside 

Tr-2) so that all the s are togethe*--, 

all the s are together, and all the 

s are together. Get started right 

away." (Walk away as soon as you are 
through with the instructions. Allow 
1 minute to elapse before doing the 
final rating and moving on to the next 
demand, unless either Tr asks you to 
clarify the instructions — in which 
case, immediately complete the last 
rating and move on. ) 

♦Insert proper items to sort depending on the WPA component. 



Provide vague 
instru ct ions 

Make eye contact; 
use neutral voice 
tone; maintain 
business-like 
manner, but 
speak/act as if 
you are in a 
slight hurry. 
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4 . Explain supervisory 
error 

Make eye contact; 
maintain neutral 
voice tone — offer 
information, in a 
somewhat apologetic 
manner . 



5 . Provide detaile d 
instructions 



To Tr-1: "I guess I must have been in 
a real hurry. I gave you the wrong 
bag to sort. The first shift has 
already been sorting these items. I 
also failed to give you the exact 
instructions and materials you will 
need. Sorry about that." 
To Tr-2: "I forgot to give you all the 
instructions and materials you needed, 
and I gave you work from the first 
shift by mistake. I can't expect you 
to do your job if you don't havis 
everything you need, can I?" 
To both: "I'll be right back with what 
you need." 

(Provide each trainee a new bag of 
materials with all three items to 
sort. Then bring 6 trays, 3 for each 
Tr, to the work station. Pick up each 
food service item as you talk, and 
point to tray onto which it is to be 
sorted. ) 

To Tr-1: "Here are the items you need 
to sort and 3 trays, one for each of 
the items you are sorting (lay out 
trays in front of Tr-1). First take 
all the out of the bag and put them 
on one tray. Be sure to get all the 

out of the bag before you start on 

the other items. Then take all the 

out of the bag and put them on 

another tray. Once you have all the 

out of the bag, sort all of the 

onto the third tray." 
(Pick up each item as you talk, and 
point to tray onto which it is to be 
sorted) . 

To Tr-2: "The materials you need to 
sort are in this bag. Each item 
shojld be placed on one of the trays 
(lay out 3 trays in front of Tr-2). 

First take all the out of the bag 

and place them on one tray. After 

you've gotten all the out of the 

bag, then start on the . Be sure to 

get all the out of the bag and onto 

the tray before you start on the . 

Sort them onto the third tray." 
(If Trs have not started work in 15 
seconds of instructions, prompt each 
to start work. Return to y ar "desk" 
for Demand 6 . ) 
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Observe trainees 
working 

Sit at your "desk. ' 
Remain silent, 
unless comments 
addressed to you 
demand an answer; 
answers should be 
neutral and matter- 
of-fact. 



No dialog unless addressed. Uiiless 
inappropriate to question, answers 
should simply direct Tr to continue 
working, (Allow iV^ minutes to elapse, 
then complete rating.) 



Stand next to 
trainee 

Stand just to side 
and rear of Tr; 
fold arms across 
chest; maintain 
serious expression. 
Any dialog should 
be nentral and 
matter-of-fact in 
tone. 



No dialog unless addressed. Unless 
inappropriate to question, answers 
should simply indicate that you wish 
to watch Tr work. (Stand over each Tr 
in turn for 15 seconds, then complete 
rating. ) 



Create a distraction No dialog. (After 60 seconds of 

noise, complete ratings.) 

Distractions may be 
created in several 
ways: (1) sort 
through a bag of 
materials not cur- 
rently in use (shake 
bag up and down and 
manipulate the items 
so as to make a dis- 
tracting noise), (2) 
play a radio loudly, 
turning it on and off 
and tuning stati:)ns 
in and out, and (3) 
enlist the assistance 
of a confederate and 
carry on a social 
conversation. All 
distractions should 
last 1 minute. 
Observe Trs but 
appear to be attend- 
ing to the distraction. 
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9. Show a new way to 
work 

Make eye contact; 
maintain neutral 
voice tone and 
matter-of-fact 
manner . 



and 
it 



9 

If 



(Demonstrate, using one each of the 
second and third items to be sorted. ) 
To Tr-1: "I want you to work a little 
differently for the next 5 minutes. 

Instead of sorting all of the out 

of the bag before starting on the 
other items, try thin and see if it 
goes faster. Reach into the bag 
pick up any item, no matter what 
is, and put it directly onto the 
correct tray. If you pick out a 
go ahead and place it on a tray. 

you pick out a , place it directly 

on the correct tray and don't worry 

about whether there are still or 

in the bag. " 

(Demonstrate, using one each of the 
second and third items to be sorted. ) 
To Tr-2i "See if you can't get more 
sorted during the next 5 minutes by 
changing how you work. What I want 
you to do is pick any item out of the 
bag and place it directly onto the 
correct tray. Don't wait to get all 

of the out of the bag before 

starting on the other items. If you 

pick up a , just put it on the tray. 

If you pick up a , go ahead and sort 

it onto the tray even if you still 

have left in the box." (After 

rating, wait 1 minute before going on 
to the next demand. ) 



10 . I ntroduce time 
pressure 

Make eye contact; 
manner and voice 
tone should have 
a tinge of 
urgency to them- — 
but avoid being 
punitive. 



To Tr-1: "You've now worked 2 minutes, 
and altogether you only have about 
(estimate %) of the items sorted. You 
have just 3 more minutes to work on 
this part of the job, so you need to 
pick up your pace." 

To Tr-2: "I see you have sorted only 
about (estimate %) of the items in 
your bag. You've alread^f' been working 
2 minutes, so you only have 3 more 
minutes on this job. You need to 
speed up." (After rating, wait 1 
minute before going on to next demand. ) 
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11, Criticize trainee's 
work 

Make eye contact, 
frown, and shake 
head; maintain ser- 
ious expression. 
CRITICIZE WORK 
METHODS, NOT THE 
PERSON. Gesture 
with the work — i.e., 
tap it on the work 
table or trays. 



12. Compliment trainee's 
work 

Make eye contact, 
smile, anc\ use 
enthusiastic voice 
tone; stand close 
(friendly zone) to 
the person (but do 
not touch). 



To Tr-lj "Just look at all the mistakes 

you've made — all these in with the 

. You need to slow down and pay 

more attention to what you're doing. 
Mistakes like this cost the company 
money. " 

To Tr-2: "This work will never pass 
quality control. You need to stop 
talking to other workers and be more 
careful to get only in this tray 
and only in this tray. We don't 
have timeTor you to do this over." 
OR 

"You're still working too slowly. We 
will never get this contract completed 
if you aon't speed up." 
OR 

"Your work is really sloppy — look at 

all these that have fallen off this 

tray. Take the time to get it in the 
right place the first time. No one 
wants to clean up after you." 
( After rating, wait 1 minute before 
going on to next demand. ) 

To Tr-1: "That's much better work! 
You really seem to be getting the hang 
of it now." (Pause briefly to allow 
for a response, if there is a verbal 
one. ) 

To Tr-2: "I can see that your work has 
improved! You're doing a good job 
now!" (Pause briefly to allow for a 
response, if there is a verbal one. 
Wait approximately ]. minute before 
going on to the next demand. ) 



13 . Instruct trainees 
to switch tasks 

Make eye contactj 
maintain neutral 
voice tone and 
business-like 
manner . 



To both: "Stop work now. I need to 
give you some new instructions. I 
want the two of you to switch jobs for 
the next few minutes. That means that 

you (Tr-1) will now sort , , and 

from this bag (switch bags). And 

you (Tr-2) will now sort , , and 

from this bag (point). Work the 

same way you have (switch trays as you 
say this) the last few minutes. It's 
only the kind of items that are dif- 
ferent. You are both to work on your 
new tasks until I tell you to stop." 
(Allow 4 minutes to elapse or wait 
until all items are sorted. ) 
"You may stop work now." (Move right 
into next demand. ) 
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1 4 . Soci al izing with 
co-worker 

Make eye contact, 
smile, but uss 
neutral voice tone 
when directing EEs 
to break area. 



1 5 . Direct trainees 
to work together 

Make eye contact; 
use neutral voice 
tone and serious 
expression; main- 
tain business-like 
manner. 



1 6 . Ask trainees to 
criticize each 
other 



To both: "Why don't you both take a 
5-minute workbreak and visit with each 
other over there (point) in the break 
area while I get your next job ready." 
(Do not speak to trainees unless 
addressed. Observe unobtrusively. 
Rate behaviors as they occur using a 
separate form to rate quality com- 
ponents, prepare materials for team 
assignment. Allow 3-5 minutes for the 
break, ) 

To both: "I want you both to return to 
your work station and begin your next 
task. Your break is over." (Remove 3 
trays from work table. Pause to allow 
EEs time to return from break area. 
If one or both have not started back 
in 10 seconds, prompt in matter-of- 
fact tone.) 

To both: "I want you to begin sorting 
the items in this bag (point) onto the 
trays (point) just as you did before. 
This time, though, I want you to work 
together on the task. You can divide 
up the work however you want to, but 
get started now." (The teamwork 
sorting items, which contain items 
from both tasks, should be placed at 
the work station when the trainees 
return from work. Allow 2 minutes to 
establish a work pattern before going 
on to next demand. ) 

To Tr-1: "Now that you've had a chance 
to work together on this task for a 
few minutes, I want you to tell your 
co-worker one thing s/he could do to 
improve his/her work. Don't tell me; 
tell him/her." (Pause to let Tr-1 
criticize and Tr-2 react,) 
To Tr-2: "Now I want you to name one 
thing your co-worker could do to make 
your task go better, faster, or 
smoother. Don't tell me; tell 
him/her." (Pause to let Tr-2 criti- 
cize and Tr-1 react.) 
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17. Ask trainees to com- 
pliment each other 

Make eye contact, 
and face trainee 
initially — then step 
back and look at 
other trainee (the 
one to be compli- 
mented). Use 
neutral voice tone, 
and matter-of-fact 
manner . 

18. Observe trainees 
completing the task 
together 

Make eye contact; 
use neutral voice 
tone, and matter-of- 
fact manner to 
give instruction. 

Then step back to 
your "desk" to 
simply observe. 



To Tr-1: "Now I'd like you to look at 
your co-worker over there, and tell 
him/her directly one thing you really 
like about how he/she works." (Pause 
to let Tr-1 compliment and Tr-2 react.) 
To Tr-2; "Now you tell your co-worker 
one thing you really like about how 
he/she works. i?Vgain, don't tell ma; 
tell him/her." (Pause to let Tr-2 
compliment and Tr-1 react.) 



To both: "OK, you now have 3 more 
minutes until the end of this work 
period. See how much you can get done 
working together during that time." 
(Refrain from any dialog with 
trainees. Wait 3 minutes before going 
on to the next demand or until all 
materials are sorted, if sooner.) 
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19 • Wo rkbreak wit h 
supervisor 

Make eye contact; 
use neutral voice 
tone and matter-of- 
fact manner to 
give initial 
instructions. 

Adopt friendly 
voice tone and 
relaxed manner and 
posture during 
"breaks". Maintain 
eye contact; smile. 



Dismiss the trainees 



To both: "The work period is over, and 
it's time lor a short break. Why don't 
you go over and sit in the break area 
for a few minutes?" (Allow them both 
to get up and start toward the break area, ) 

To Tr-1: "Before you take a break, , 

I'd like to see you a moment (let Tr-2 
go on). Have a seat. I really 
haven't had a chance to visit with you 
since you came to work for us. How is 
everything going?" Ask one or two 
socializing questions like "Where is 
your home town? Do you still have a 
family there? Do you have a family?" 
Present Tr-1 with 15 seconds of 
silence — no dialog unless s/he ini- 
tiates it, in which case you respond 

accordingly. "OK, , thanks for 

visiting with me (pause). Have a seat 
over in the break area now, if you 
will, until I call you." (Limit 
segment with Tr-1 to 4 minutes maximum. 
Quickly rate Tr-1 before calling Tr-2. 
Use separate sheet for quality 
components . ) 

To Tr-2: " , would you come over here 

for a few minutes, please? (pause) 
Have a seat, won't you? I just wanted 
to get acquainted with you since 
you're a new employee. How is 
everything going?" Ask one or two 
socializing questions like "What do 
you like to do in your spare time? 
What are your hobbies? Do you like 
sports?" Present Tr-2 with 15 seconds 
of silence — no dialog unless s/he ini- 
tiates it, in which case you respond 

accordingly. "Ok, , thanks for 

visiting with me (pause). Why don't 
you go back over to the break area for 
just a few minutes?" (Limit segment 
with Tr-2 to 4 minutes maximum. 
Quickly rate Tr-2 before closing the 
unit. Use separate sheet for quality 
components . ) 

To both: "That will be all for today. 
You can step out of your role as a new 
employee. You can now return to your 
training area. Thanks for coming. 

We'll see you back here at 

tomorrow, OR, This is the last day we 
need you to do this," 
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WPA Rating Form 



Rater . Trainee 1 



Date ^WPA Component Trainee 2_ 

Dire c tions : Indicate on this rating sheet whether Trainee 1 
(Tr-1) and Trainee 2 (Tr-2) exhibit specific behaviors following 
presentation of each WPA demand. Check each behavior performed 
by each trainee. DO NOT CHECK ANY BEHAVIORS THAT ARE NOT 
PERFORMED. 

1. Demand : Greet each trainee (Tr) Tr-1 Tr-2 

Ratings 

Makes eye contact (looks at Supervisor (S) while 

S is speakinq). 

Returns greeting (says "hello", "good morning/ 

afternoon", etc.). 

Responds to S's inquiry (states how he/she is 

doing) . 

Asks S a greeting related question (says "how 

are you", "how is .\t going?"). 



2. Demand : Direct trainees to work station and 
explain source of work 

Ratings 

Takes seat when told. 

Acknowledges assignment in an appropriate verbal 
manner (e.g., "OK", "All right", "That sounds 
good", "I understand"). 

Listens without interrupting, grimacing, or making 
hostile/sarcastic comments. 



3. Demand: Provide vaatie instructions 
Ratings 

Makes eye contact (looks at S while S is speaking; 

may glance at tasks as S points them out). 
Listens without interrupting, grimacing, or making 

hostile/sarcastic comments. 
Starts task immediately (within 5 seconds). 
Asks S to clarify sorting instructions or 

indicates a need for additional materials. 
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4. Demand ! Explain supervisory error 



Ratings 

Makes eye contact (looks at S while S is speaking). 
Acknowledges S's error verbally without hostile/ 

sarcastic coiriments. 
Stops work until new instructions and/or materials 

are received 

5. Demand ; Provide detailed instructions 
Ratings 

Makes eye contact (looks at S while S is speaking; 

may glance at tasks as S points them out). 
Verbalizes understanding of task (e.g., "OK, I 

understand", "I'll do it", or repeats the 

assignment ) . 
Starts work immediately (within 5 seconds). 
Works without prompting or excessive questioning 

or complaining. 
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Demand: 



Observe trainees working. 



!i(atinqs 

Works steadily (works at a pace consistent 

with cognitive and physical capabilities without 
stopping for prolonged periods of time). 

Works on task without disrupting others by 
talking or creating a distraction. 

7. Demand ; Stand next to trainee 

Ratings 

Works steadily in S's presence (stops only to 
ask an appropriate job related question). 

8* Demand ! Create a distraction 

Ratings 

Does not stop working for longer than 5 seconds. 
Refrains from excessive complaining or hostile 
remarks. 
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9. Demand ; Show a new way to work 



Ratings 

Makes eye contact (looks at S while S is talk- 
ing; may glance at tasks as S points them out). 

Verbalizes understanding of new work method (says 
"I understand", "OK, I'll do it" or restates 
assignment) . 

Changes work method when instructed. 

Resumes work without becoming upset (no grimacing 
or hostile/sarcastic comments). 

Works without prompting or excessive questioning 
or complaining. 

10. Demand ; Introduce time pressure 

Ratings 

Speeds up work pace. 

Works without arguing or becoming upset (no 
complaining or hostile comments). 



ERIC 



28 



11. Demand: Criticize trainee's work 



Ratings 

Makes eye contact (looks directly 
at S while S is speaking). 

Acknowledges S's criticism verbally 
(e.g., "Oh, I see", "I understand", 
"That's a good idea," etc.). 

Resumes work without arguing, 
complaining, making sarcastic/ 
hostile remarks, and/or dis- 
rupting work area. 

Corrects error. 

12. Demand ; Compliment trainee's work 
Ratings 

Makes eye contact (looks at S 

while S is speaking). 
Says "thank you" or other appropriate 

verbal recognition of praise. 
Nods head or otherwise gives appropriate 

nonverbal acknowledgement of praise. 
Continues working. 

13. Demand: Instruct trainees to switch tasks 
Ratings 

Makes eye contact (looks at S when S 

is speaking). 
Stops as soon as told (within 5 seconds). 
Maintains eye contact with S or task. 
Starts work as soon as told to 

(within 5 seconds). 
Works steadily until told to stop 

(works on task without stopping to rest 

or talk to others, etc.). 
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14. Demand ; Socializing with co-worker 



Ratings 

Asks opening question (e.g., "How's it 
going?", "What's new?", or "How do you 
like this work?" ) . 

Responds appropriately when co-worker 
initiates conversation. 

Asks follow-up question. 

Maintains conversation. 

Expresses self-disclosures appropriately 
(states opinion; relates appropriate 
personal information, e.g., "I like etc 

Verbalizes appropriate conversational closing 
when asked to return to work. 

15. Demand t Direct trainees to work together 
R atings 

Starts back from break area immediately 

(within 10 sec. ) . 
Refrains from complaining or becoming upset 

(no hostile/sarcastic remarks). 
Makes eye contact (looks at S while S 

speaks; glances at tasks as S presents them). 
Verbalizes understanding of task (says "I 

understand", "I see", or repeats 

instructions, etc.). 
Verbalizes that he/she will do a specific 

task. 

Begins work immediately on team assignments 

(within 5 seconds.). 
Works steadily on tasks (does not stop to 

talk or rest, does not disrupt work activity) 

16. Demand: Ask trainees to criticize 
Ratings 

Names at least one concrete change in work 

procedures. 
Makes eye contact with Tr when giving 

criticism.. 

Makes eye contact when receiving criticism. 
Nods head or says "OK," etc. to 

acknowledge criticism. 
Refrains from becoming upset/defensive. 
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17. Demand ; Ask trainees to compliment 



Ratings 

Names at least one positive work behavior. 
Makes eye contact with Tr when giving 
compliment. 

Makes eye contact when receiving compliment 
Says "thank you". 

18. po-mand ; Observe trainees working 
Ratings 

Starts back to work immediately 

(within 5 seconds.). 
Refrains from complaining, sarcastic 

remarks, or excessive questioning. 
Works steadily through entire work period 

(does not stop to talk or rest; does not 

disrupt work activity). 
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19. Demand ; Workbreak with supervisor 



Ratings 

Res(.jnr*s appropriately when S initiates 

conversation, 

Maintains conversation with S. 

Looks at S while S is speaking. 

When presented with silence, asks an 

opening question. 

Asks follow-up question. 

Maintains conversation. 

Expresses self-disclosures appropriately 

(states opinions, likes, or dislikes). 

Verbalizes appropriate conversational closing. 

20. List any specific employability limitations or assets that 
should be considered in each trainee's work adjustment or 
placement 



Trainee 1: 



Trainee 2: 
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WPA Work Break Rating Form 



Trainee 1: Rater: 



Trainee 2:_ WPA Component: Date: 



Directions: Indicate whether Trainee 1 (Tr-1) or Trainee 2 
(Tr-2) exhibit any of the following behaviors. Rate their per- 
formance during the work break segments by placing a check mark 
next to each behavior performed. DO NO T CHECK ANY BEHAVIORS 
THAT ARE NOT PERFORMED. 



Tr-1 Tr-2 

Demand 14. WorK Break with Co-worker 

Quality Components 

Pleasing voice tone and volume _ 

Appropriate eye contact I 2 

Appropriate posture 

Positive emotional tone 

Expresses enthusiasm through facial expressions 

and gestures 

Appropriate dress 

Acceptable personal hygiene 



Demand 19. Work Break with Supervisor 

Q uality Components 

Pleasing voice tone and volume 
Appropriate eye contact 
Appropriate posture 
Positive emotional tone 

Expresses enthusiasm through facial expressions 

and gestures 
Appropriate dress 
Acceptable personal hygiene 
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Appendix B 

Study 1: Hot Springs Rehabilitation Center 



Reliability/Validity Study 1 



ERIC 



Nineteen male students and five female students at the Hot 
Springs Rehabili tatioti Center participated in the first study 
(N=24). Based on result-: of a staffing, 12 students recommended 
for work adjustment services at the Center and 12 recommended 
for vocational training were selected. The work adjustment 
grouD consisted of 8 men and 4 women; the direct to vocational 
training group, 10 men and 2 women. All of the participants 
were judged eligible for rehabilitation services in Arkansas. 
Disability breakdowns for the two groups were as follows: 
Vocational training group — emotional ( n=2 ) , physical (n=9) and 
intelle'Ttual (n=l); work adjustment group — emotional (n=5), 
intell lal (n=2), and physical (n=5). 

Although both groups were young (19 and 28 years of age on 
the average), the direct to vocational training group was signi- 
ficantly older t(22)=2.92, £<.01. At the same time, the work 
adjustment group reported more years of education (M=11.08, 
30=1.73) than did the direct to training group (M=9.75, 
SD=1 . 76 ) , t(22)=1.87, p<.10. No differences were found between 
the work adjustment and vocational training groups respectively 
on intelligence as measured by the Beta (M=87.67 and M-92.56) or 
achievement (grade level) as measured by the Wide Range 
Achievement Test (Reading - M=6.91 and M=6.25; Spelling - M=5.92 
and M=5.08; Math - M=5.92 and M=6.58). Although comparable to 
the direct to training group in intelligence and achievement, 
the work adjustment group was younger, somewhat better educated, 
and more likely to report emotional disorders. 

All participants completed the three WPA components (I, II, 
III). The research design made it possible to administer each 
WPA component in the first, second, and third positions. Hence, 
all six possible orders were used. The design also called for 
each of the three female research assistants to administer each 
component an equal number of times and to appear in each admi- 
nistration position an equal number of times. Finally, the 
design enabled each participant to have a different partner for 
each of the three WPA components. In no cases were the groups 
mixed, i.e., WPA pairs consisted of either 2 work adjustment or 
2 vocational training students. Whenever possible students 
completed the WPA on three consecutive days or, at least, within 
one week's time. 

Each WPA presentation was scored by the evaluator (in 
vivo). Videotapes of these sessions were then rated by the 
remaining two evaluators who were then filling the role of 
tape raters. 

Participants in Study 1 demonstrated approximately 61% to 
66% of the criterion behaviors on the WPA. For example, on the 
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initial WPA administration, regardless of form or administrator, 
the average in vivo rating (proportion scores, i.e., percent of 
83 criterion behaviors demonstrated) for the 24 students was 
60.79 with a standard deviation of 9.81. Tape rating estimates 
were similar with proportion scores of 64.75 (6.50) and 63.88 
(6.79) . 

The extent of agreement between in vivo and tape ratings is 
presented in terms of both a narrow and wide observational base 
or behavioral sample. For example, the narrower base on which 
to judge the agreement of the in vivo/tape ratings involved com- 
paring the first in vivo administration of the WPA (regardless 
of form or administrator) and the two related tape ratings. 
This comparison involved only one estimate (first administration 
only) of an individual' 3 employability . 

No mean differences [F(2 , 69 )=1 . 69 , 2='^s. ] were found among 
the comparisons of initial in vivo scores (M=60.79, SD=9 , 81 ) and 
their two tape rating scores (M-64.75, SD=6. 50 and M=63.88, 
SD=6 . 79 ) . Agreement between the in vivo scoring of the first 
administration of the WPA and the two tape ratings was signifi- 
cant at the .01 level (In vivo/Tape 1, r=.61, d<.01; In 
vivo/Tape 2, r=.77, 2<'0^)' 

Using the broadest behavioral sample possible (all WPA in 
vivo composite scores and all tape rating scores across three 
sessions), agreement was examined in a second analysis. In 
effect lengthening the WPA three times, this approach 
established the outer limits of agre'^ment on employability as 
measured by the WPA. The correlatio between total WPA scores 
from in vivo estimates (3) and from tape rating estimates (6) 
was .88, £<.01. 

Reliability of the WPA can, therefore, be enhanced by 
increasing the number of judges and averaging their scores or by 
administering additional forms of the WPA. Using the second 
strategy (administering additional forms), one extends the 
period of behavioral observations and, thus, the generalizabi- 
lity of the composite score. 

Several other key questions regarding use of the WPA were 
also examined, namely the effects of different administrators; 
the comparability of WPA I, II, and III; and the effect of order 
of administration. When all ratings (in vivo and tape) were 
considered, the three factors had minimal influence on WPA 
results. For example, although Administrator 1 (Adl) reported 
significantly lower scores for the 24 students than did admi- 
nistrator 3, no differences were found between the scores of 
administrators 1 and 2 and 2 and 3. The three scores were as 
follows: Adl, M=61.35, SD=9.51; Ad2, M=66.55, SD=8.91; and 
Ad3, M=68.75, SD=8.14, F ( 2 , 57 )=3 . 67 , 2<*05. Agreement among the 
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administrators was, however, low using their scores (in vivo) 
only, e.g., Adl/2, r=.39, £=.10; Adl/3, r«.68, £<.01; and Ad2/3, 
r-.40, £<.10 

When all estimates (tape and in vivo) were considered, 
administrator effects decreased somewhat. Scores from the three 
administrators, one, two, and three respectively, were as 
follows: M=63.50, SD=7.07, M=67.25, SD=6.64, M=68.00, SD=7.01 
with only a statistical trend for administrator 1 to differ from 
administrators 2 and 3; F( 2 , 57 )«2 . 44 , £<.10. With the broader 
behavioral base for estimating employability, administrator 
agreement increased considerably, e.g., Adl/2, r-.61, £<.01; Ad 
1/3, r=*.63, p<.01), and Ad2/3, r=.58, d<.01. 

Equivalence of the three WPA forms (I, II, III) was also 
examined. Using only the in vivo scores for forms I, II, and 
III of the WPA, one finds similar mean proportion scores, 
M=64.10, SD=10.06, M=68.20, SD=9.19, and M=64.35, SD=8.34, 
respectively; F( 2 , 57 )=1 . 24 , p=ns. Agreement between forms I and 
II (r=.35, p=ns.) and between forms T and III (r=.28, p=ns.) is 
low while agreement between forms II and III is high (r=.64, 
2<.01) using the in vivo score only. 

When the composite scores are considered, i.e., the esti- 
mate of a participant's performance on a specific WPA form based 
on all available in vivo and tape ratings, the agreement 
increases for all forms except the form II/III correlation. As 
in the past, average scores for each form are similar; Form 1, 
M=65.65, SD=6.60; Form 2, M=67.55, SD=7.84; and Form 3, M=65.55, 
SD=6.90; F(2,57)=.50, Agreement correlations are in the 

.50 to .59 range, e.g., I/II, r=.59, 2<.01; I/III, r=.52, £<.05; 
II/III, r=.50, £<.05). As would be expected, multiple estimates 
of performance yielded higher levels of agreement across WPA 
forms. 

The effect of order in which the components were admi- 
nistered was also examined. Based on n'lly the in vivo scores, 
order does not affect group scores. Wt. proportion scores in 
order of administration were M=64.85, SD=9.29, M=66.00, SD=9.07, 
and M=65.80, SD=9.84; F(2,57)=.09, p=ns . Agreement is another 
matter. Though mean scores were not significantly different, 
agreement was low, e.g.. Order 1/Order 2, r=.58, 2<.01; 1/3, 
r=.34, £=ns; 2/3, r=.22, 2=ns ) . 

When additional WPA estimates are considered (all possible 
in vivo and tape estimates for orders 1, 2 and 3), agreement 
increases. Again, mean differences for order were not found, 
M=66.35, SD=6.89, M=66.05, SD=7.26, M=:66.65, SD=7.03; 
F(2,57)-.02, £=ns. Agreement among the orders was as follows: 
Order 1/2, r=.56, £<.01; 1/3, r=.54, 2<.01; 2/3, r=.46, £<.05). 
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In Study 1, the WPA performance of the two criterion 
groups, work adjustment (group 1) and vocational training (group 
2) did not differ. Based on a composite in vivo score across 
three administrators, group I's proportion score was M=63.97, 
SD=8.49, and group 2's, M=67.13, SD=:5.61, t(19)=.98, p-ns. 
Composite scores based on tape ratings only were also similar 
(group 1, M=66.18; group 2, M=66.93), t(10)=.29, £=ns. 

Data from multiple forms and raters indicate that the WPA 
can be scored with high interjudge agreement. Additional deve- 
lopmental research, however, is needed to enhance the parallel 
form reliability of the measure. In addition, more intensive 
evaluator training is suggested in order to minimize the admi- 
nistrator effect. Finally, additional validity evidence as pro- 
vided in the study to follow is needed. 
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Reliability/Validity Study 2 



Conducted at Timber Ridge Ranch (Community Re-Entry 
Services of Arkansas), the second study examined whether the 
behavioral responses to the WPA could be reliably scored, 
whether those responses would be stable across parallel WPA 
forms, and whether differences could be observed between two 
criterion groups, clients ready for vocational training or job 
placement and clients referred for work adjustment training. 
Twenty-four adults with traumatic brain injury (TBI), twelve job 
placement clients and twelve vocational adjustment clients, were 
administered each of the three units of the WPA. Clients par- 
ticipated in one WPA unit per day with two to three days 
separating the three unit administrations. 

Three vocational rehabilitation counselors participated as 
administrators in the study and scored client performance. Each 
person's score on a WPA unit represented the proportion of beha- 
viors rated as present out of 1 te l-.otal number of behaviors 
possible. The order in which f inits were administered was 
counterbalanced so that each un.' ' s administered in each posi- 
tion (i.e., first, second, third • equal number of times. 
Each WPA administration also was v.ueotaped, and two raters 
later scored the videotapes independently. Interobserver 
agreement between the two videotape raters and between each 
videotape rater and each administrator was then calculated. 
While simple occurrence reliability assessments yielded 
agreement scores of .88 to .92, Kappa Coefficients of 
Reliability ranged in value from .74 to .81. Kappas were calcu- 
lated because they were a more stringent measure of reliability. 
Thus, the data Indicated that the WPA units can be reliably 
scored either by administrators in vivo or from videotape by 
trained raters. 

No significant differences were observed among the scores 
obtained on the three units for clients in either criterion 
group. Specifically, with data collapsed across administrators, 
the mean scores for the good worker group on units I, II, and 
III were 74.67, 75.75, and 74.58, respectively. For the work 
adjustment group, the means were 58.08, 57.76, and 56.60 for 
units I, II, and III, These findings indicated that the three 
WPA units were equivalent, i.e., yielded similar estimates of 
the job maintenance skills. 

The effects of repeated exposure to the WPA were also exa- 
mined. No significant differences were observed among scores on 
WPA units which were administered first, second, or third. 
Thus, client performance was basically stable across the three 
administrations of the different WPA units irrespective of the 
order in which they were presented. 
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The data did demonstrate that performance on the WPA could 
be affected by the particular administrator who was present. 
While the average WPA proportion scores for the work adjustment 
group were similar across administrators (54.30, 57.33, 57.17), 
there was a significant administrator effect in the good worker 
group (P{2,32)«5.75, £<.01). In this group, the mean scores 
elicited by the three administrators were 81.67, 71.42, and 
71.92, with significantly better performance seen with admi- 
nistrator 1, a female,, than with the other two administrators 
who were both males. Obviously, further research is needed to 
determine the characteristics of the administrators (e.g., 
gender, demeanor, presentation style, etc.) that influence 
client performance. 

In terms of group differences, the job placement group 
demonstrated consistently better job retention skills than the 
work adjustment group (M=75.08 vs. M«57.25), a difference which 
proved to be highly significant (F(l,22)=137.78, £<,001). 
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WPA SCRIPT & RATING FORM 

Developed by 



Richard T. Roessler 

Arkansas Research & Training Center 
In Vocational Rehabilitation 
University of Arkansas. Fayettevllle 
Arkansas Rehabilitation Services 



SukI HInman 
h'rank D. Lewis 

Coinnnunlh/ Re-Entry Services of Arkansas 
A Progronn of the New Mexico Head Injury Systenn 
Benton, Arkansas 



WPA SCRIPT & RATING FORM 

was redesigned into a booklet format 
for ease of handling. 
Each booklet contains a 
script and rating fomn. 
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Mroduction to WPA Trainees 



Before we begin today, let me tell you about wtiat you 
will be doing. You will be working with the WPA (Work 
Performance Assessment), w!iict> is a measure of ttie 
way people work when given different Jobs to do. As you 
perform the different work activities, please observe the 
following rules: 

1. Act as If you are a new employee on the Job. 

2. Pretend that you ore an hourly employee being paid 
for the Jobs you are asked to do. 

3. Pretend I am your supervisor; treat me just as you 
would if you were actually on a job. 

Do you have any questions? We are now ready to 
begin. You are a worker and 1 am your supervisor. Our 
job is In the next room. (Mdwinistrator—M opms door to room «Atf 
uyK) At this time, I would like both of you to go to the 
work area (ipoint to the work area). 1 Will Join you there, greet 
each of you, and exoloin the day's work to you. From 
that point on, I will answer only those questions that are 
appropriate for a work supeivlsor. Remember to stay \\) 
your role as a worker and I will stay in my role as your 
supervisor. 



Ii2 



UJork Performance flssessment 

SCRIPT 



Directions 

Follow the scripted material (demand/demeanor 
and dialog/directions) to present each or \he 19 
WPA work demands. Remember to assume the 
role of a work supervisor and to present the 
demands In a similar style to each trainee. Stress 
how Important it Is that trainees remain In the role 
of workers throughout the assessment. 
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UJork Performonce <^ssessment 

AATEHG FORM 



Directions 

Indicate on the rating stieets wtiettier Trainee 1 
(Tr-i) and Trainee 2 (T^2) extiibit specific 
behaviors following presentation of each WPA 
demand. Check each behavior perfornned by 
each trainee. Do not check any behaviors that 
are not perfonned. 
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Dem§ml/l>Bmeanor 



DMog/Direeiions 



1. OfMt Mch IralnM (H) 

Smile. octMendly and 
intereited; look at each 
trainee during greeting. 



To both: "Good rYionilni^/s^iei. 
(maHltrlHtyHrntty) 



ToTM:"How are you, 



r 



TeTI>4:"And. 

you doing?" 



. , tiow ore 



2. Direct traineM to woifc 
ttoHon and explain touie* of 
wortc 



3. Provide vogue IndnjcHont 

Make eye contact; use 
neutral voice tone; maintain 
business-like manner, but 
speoK/oct OS If you ate in o 
sllgtit huny. 



To botti: "Let me stiow you to vuur work station. 
Come over here to this table and havo a seat. We 
hr.-e some targe contracts with several fast food 
restaurants. One of our Jobs is to sort food service 
items that get mixed up during rush hours when 
busy employees are hurrying to nil orders as fast 
OS they can. That's what both of you will be 
working on this moming/aftemoon." 

(Tun »vir,y (o pfek up h»f cenUlaliig Htmt to b* torfd, 
mhkh an naMM for tho aoxt domaad.) 

To TM: "In this bog ate some (Ood setvlce items 
that oie mixed up (flaea hag iaaUa U). Your task is 
to soit the Items out so that oil the 

s are together,* oU the 

8 are together,* and oil the 

s are together.* Go oheod and 

begin now." 

To T^2: "This is your bog of mateitals. You ore to 
sort out these foo<l seMce items dtlacakagbatUo 

so that aH the s ore together,* 

on the , — s are together,* and oil the 



away." 



. 8 are together.* Get staited right 



(WatkamafaaaaaKatyavanmaa^wmtkahianicthaa. 
MlhmoaamlmtataaUnaDafanMnilialliialraHimaai 
amlagaah ttc mxHaauai. gamH^ M aUm ii atk$ m 
UtMdflkaMmUm.) 



^ * Insert pfoper Items to sort depending on me WPA compoiient. 
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1. DiMAND: OiMl MCh ffolffiM (EE). 

Makes eye contoct (looks at Administrator— Ad wtille Ad Is speaking). 

Returns greeting (says ''Hello;' ''Good moming/altemoon" etc.). 

Responds to Ad*s Inquiry (states how he/she Is doing). 

Asks Ad a greeting related question (says "How ore you?" 
"How Is It going?"). 

2. DEMAND: Direct lialnees to work station and explain source of work. 
RMtingB 

Takes sect wtien told. 

Acknowledges assignment In an appropriate vertxal manner 
(e.g.. *'OK." "All right." "That sounds good/' "I understand"). 

Listens without Interrupting, grimacing, or making hostile/sarcastic comments. 



3. DEMAND: Provide vogut InstmeHons. 

Mokes eye contact (looks at Ad while Ad Is speaking: 
may gkance at tasks as Ad points those out). 

Listens without Interrupting, grlmoclng. ormaking hostile/sarcastic comments. 

Starts task Immedbteiy (within five seconds). 

Ask$ Ad to ckirify sorting Instructions, or Indicates a need 
for oddlttonoi moteriois. 
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Dmand/Dmeanor 



DiMlog/Dirttions 



4. Explain tup0ivltory •rror 

Make eyo contac* maintain 
neutral voice tone— offer 
Information, nof on apology. 



5. Piovkto dttalM InslnieMPM 



To TM: *1 guess I must ha^e been In a real hurry. 
I failed to give you the exoct In^tajctions and 
materials you will need." 

To Tr-2: "1 forgot tc give you oil the Instructions 
and materials you needed, i can't expect you to 
do your Job If you don't hove everything you 
need, can I?'' 

To both: 'Til be right back with what you need." 

(Bring §lx ir^ ikr— hr iE, wHk ymi wrk MtaVm. 
fkk m Mc* NtmM/Mf (iMt, smitfolat to (r^ Mrto wkkk H 

To TM: "Hers ore three troys, one for each of the 
Items you are sorting (i^ o«( tntys kitmitil Tr^i). 

Rrst take all the out of 

ttio bag ond put them on one troy. Be sure to get 

oil the out of the bag 

before you start on the other Items. Then toke oil 

the out 01 tt>e bag and 

put them on onother troy. Once you hove oil the 

out of the bag, sort oil of 

the onto the third tray," 

(Pkk i# KfM s$p^t»lk, smlfcMt» trajf onto irJrM N 
/stottfortstf;. 

To Tk^S: ''Each Item you ore sorting should be 
placed on one of the troys (Ig/ out MrM trayt In from 

•f Tr-lh Rttt take all the 

out of ttie bag ond pksce them on one tray. After 

youVa gotten oil the out of 

the bag. then stoit on the 

Be sure to get oil the 



out of ttie bog ond onto the tray before you start 

on the Soft them onto 

Ihe third tray." 

(If EEi tov# tUrM wertt ki IS seconds of ItntnteUontf 
promfitoaeh to oUH woriu fftdfrn to your 'Vfoifc'* for Oomsmf 
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4. DMAND: Exptain Mipsfvtsoiy •nor. T^1 T^2 

Makes eye contact (looks at Ad wtille Ad Is speaking). 

Acknowledges Ad's error vertxilly without hostile/sarcastic comments. 

Stops work until new Instructions and/or materials are received. 

5. OIMMD:PievW*dtlaiMlnilnioNoi^ TM T^2 

Makei ey» contact (iooict at Ad while Ad is speaking: may glance 

ot taslaat Ad polntf thorn out). 

Vertxilizes undentdndlng oftask (e.g.. "OK. i undefttand." 

"ill do It." or wpeali me assignment). 

Starts wori( ImmadioMy (within flw seconds). 

Works without prompllno or excessive questioning or complaining. 
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Dmtml/lhmmor 



DMog/Dincilotts 



6. ObMivt fralriMs working 

Sit at your "desk." Remain 
silent, unless comnnents 
addressed to you demand 
an answer answers stiould 
be neutral and matter-of-fact. 



No dialog unless addressed. Unless Inappropriate 
to question, answers* should simply direct EE to 
continue working. 

(Alhw VA mlm*0$ to ttopst, Hmn cemnMt rttlng.) 



7. Mgnd imflD litiln— . 

Siond M to ikto ond fear or 
EE. offfisioldMlocfpiM ch«it, 
Mrioui ixpi«Mi6ri» Any cAolog 
should b« n«ut»t and nxrtler^ 
oMoetinton*. ; 



Mo dialog untott dddrMMd. Unlets inoppioprtde 
fo question, atuwefs should simply Indicale that 
you wish fo weiich EE woik. 

(StMrf Mr WNfe IE is im liir IS SNMii^ IftM CMvlMf 



9a Ciecito Q cNftracHon 

Distractions oKiy be cieoted 
In se^^rol ways. One metfiod 
is to sort ttirougti a bag of 
materials not currently In use 
(stKske bag up and down 
and nrKinlputerte ttYe items so 
as to make a distracting 
noise). Anottier mettiod Is to 
pksy a radio k)udly. turning it 
on and off and tuning 
stations In and out. A ttilrd 
mettiod Is to enlist ttie 
assistance of a confederate 
ottierwise not Involved In the 
assessnnent. and carry on a 
socksl conversotion. Ail 
distractions stioukJ ksst one 
minute. T?ie Ad stiould 
obser/e EEs but oppeor to be 
attending to tt>e distraction. 



No dialog. 

(AH»r 45 SMMNb of iw/st, compkt9 ntings,) 
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SCRIPT 

4 



6. DEIMAND: Obswfv* IniIimm woiMng. TM T^2 

Works steadily (works at a pace consistent wttti cognitive and physical 

capabilities wittiout stopping for prolot ^fid periods of tlnne). 

Works on task wittiout dtsmptlng ottiers by talking or creating a dlstractkxi. 

1M IM 



WortdtlMcUiy in AcTt ptetence (stops only tootkon apptoprtate 

Job nial9d quetHon). 

B. DEMAND: CTMto o cNslracHon. T^1 T^2 

Doe$ not stop working tor longer ttion fh/e seconds. 

Refrains Itom excessive complaining or hostile remarks. 
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Demand/Deni^aiior 



Diilog/Directiotts 



Show a now woy to work 

Make eye contact; molntoln 
neutral voice tone and 
matter-of-fact manner 
Address eccti trainee 
IndMdualty. 



10. Introduce time pressure 

rvloke eye contact, fvionner 
and voice tone should have 
a tinge of urgency to thonn— 
but ovoid being punitive. 



(DBmottitrii§, using one §Hh of Me steoad and third itm$ 
!o bf soffd.) 

To Tr-1: "I want you to work a little differently for 
the next five minutes. Instead of sorting ail of the 

out of the bog before 

starting on the other Items, try this and see if it 
goes faster. Reach Into the bag and pick up any 
Item, no matter what It is. and put It directty onto 

the correct tray. If you pick out a , 

go ahead and ploce It on a tray. If you pick 

out a , place It 

directty on the correct tray and don't worry 
about whether there are still or 



in the bag." 



(DBmon$trMt9, us/nf oirt 9Mch of th§ SHond Mnd third Hms 
to be lortfdL j 

To T^2: "See if you can't get more sorted during 
the next five minutes by changing how you work. 
What I wont you to do is pick any Item out of the 
bag and place It directty onto the correct tray. 
Don't wait to get all of the 

out of the bag before 

storting on the other items, if you pk:k up a 

, Just put tt on the tray. If 

you pick up a . go 

ahead and sort It onto the troy even If you still 
have left In the box." 

(Affir rating, wait m mimita Mora going on to tha naxt 
demand.) 

To Tr^l: 'You've now worked two minutes, and 
altogether you only have about (estimate %) of the 
items sorted. You have Just three more minutes to 
work on this port of the job. so you need to pick 
up your pace." 

To Tr-2: "I see you hove sorted only about 
(estimate %) of the Items In your bag. You've 
already been working two minutes, so you only 
have three more minutes on this Job. You need to 
speed up." 

(After rating, wait one minute before going on to next 
demand.) 



Gl 



9. DEMAND: Show a now vray to woifc. 

Makes eye contact (looks at Ad while Ad \t talking; may glance at 
tasks as Ad points ttiem out). 

Vertxillzec understanding of new work niethod (says "I understand," 
•'OK. ril do It," or restates assignment). 

Ctianges work rnettiod wtien Instructed. 

Resunnes work without becoming upset (no grimacing or hostile/sarcastic 
comments). 

Works without prompting or excessive questioning or complaining. 



10. DiMAND: Introduce time pressure. 
RMtings 

Speeds up work poce. 

Works without arguing or Isecomlng upset (no complaining or hostile 
comments). 
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Demand/Demeanor 



Dialog/Directions 



11. CrttlclM tralnM't wofic 

Make eye contact, frown, 
shake head, maintain serious 
expression. B« sur» to 
crHlcIxe work rmthodt, not 

the person. Gesture with the 
work— I.e., tap It on the work 
table or troys. 



To M: "Just look at all the mistakes youVe 

made— all these In with 

the You need to slow 

down and pay more attention to wtiat you're 
doing. Mistakes like this cost the company 
money." 

To T^2: "This work will never pass quality control. 
You need to stop talking to other workers and be 

mone careful to get only 

In this tray and only - in 

this tray We don't have time for you to do this 
over." 



or 



"You're still working too slowty. We will never get 
this contract completed If you don't speed up." 
or 



You're being really sloppy— look at all these 

that have fallen off this 

troy. Take the time to get It <n the right place the 
first time. No one wonts to hove to clean up after 
you." 

(After rating, wait ont minute betore going on to next 
demand,) 



12. CcmplimavTt trainee's work 

Make eye contact, smile, use 
enthusiastic voice tone, stand 
close (friendly zone) to the 
person (but do not touch). 



To Tr-1: "That's much better worki You real^/ seem 
to be getting the hong of It now." 

(Pause briefly to allow for response, If there Is a verbal one.) 

To Tr-2: "1 can see that yaur work has Improvedl You're 
doing a gaod job now!" 

(Pause briefly to allow for response^ if there Is a verbal one. 
Wait approximately one minute before going on to the next 
demand,) 
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11. DiMANO: CfllieiM trainM'i wvoifc. 

Makes eye contact (lookt directly at Ad wt)lie Ad Is speaking). 

Acknowledges Ad's dttolsm veiboliy (e.g., "Oh, \ see," "I understand," 
"That's a good Idea," etc.). 

Resumes woik wltt^ arguing, complaining, nxsklng sarcastic/hostile 
remarks, and/or disrupting work area. 

Corrects error. 



12. DEMAND: Compliment trainee's work. 
Ratings 

Mokes eye contact (looks ot Ad while Ad is speaking). 

Soys 'Ihonk you" or other oppropriote veiboi recognition of prolse. 

Nods head or otherwise gives oppropriote nonvortxjl ocknowledgenrient 
of praise. 

Conti.iues working. 
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Demand/Demeanor 



Dialog/Directions 



13. Instnjct tialnaes to switch 
tasks 

Make eye contact: maintain 
neutral voice tone and 
buslness-IIke manner. 



To botti: "Stop work now. I need to give you some 
new Instructions. I want the two of you to swltchi 
jobs for the next few minutes. That means that you 
(Tr-J) will now sort , 



and 



from this bag (switch bsgs). And you (Tr-l) will now 

sort , , 

and from this bag (point). 

Work the same way you have (switch trays as you say 
this) the last few minutes, it's only the kind of items 
that is different. You are both to work on your new 
tasks until I tell you to stop." 

(Mow four mittut0S to etapS0 or wait untii aii items are 
sorted.) 

'You may stop work now." 
(Moire right into next demand.) 



14. Sociailzing wtth co-worker 

Make eye contact, smile, but 
use neutral voice tone when 
directing EEs to break area. 



To bofti: "Why don't you both take a five-minute 
workbreak and visit with each other over there 
(point) in the break area while i get your next Job 
ready." 

(Do not speak to trainees uniess addressed. Observe 
unobtrvsiveiy. Rate behaviors as they occur using a separate 
form to rate quaitty components. Prepare materiats for team 
assignment. Aiiow 3-5 minutes for the break.) 



15. DIroct trainees to work 
togettier 

Make eye contact; use 
neutral voice tone ar^d 
serious expression; maintain 
business-like manner. 



To both; "I want you both to return to your work 
station and begin your next task. Your break Is 
over." 

(Remove three trays from work tahie. Pause to allow EEs 
time to return from break area, if one or both have not 
started back in 10 seconds, prompt in matter^f-fact tone ) 

To both: "I want you to begin sorting the Items In 
this bag (point) onto the trays (point) Just as you did 
before. This time, though. I want you to work 
togettier on the task. You can divide up the work 
however you want to, but get started now." 

(Allow two minutes to ostabiish a work pattern before going 
on to next demand.) 



13. OBMAND: imhUGf IfOlMes to swHeh totkt. 

Makes eye contoct (looks o( Ad when Ad Is specking). 

Stops OS soon OS told (wittiln five seconds). 

Molntoins eye contact wttti Ad or task. 

Starts wortc as soon as told to (wtttiln five seconds). 

Works steadily until total to stop (wortcs on task wittiout stopping to rest 
ortatktoottiers,etc.). 




14. Df MAND: Soclalizir^ wltti co-wdker. 
ffsf/nfs 

A^ks opening question (e.g., "How's It going?" "What's new?" or 
"How do you like this work?"). 

Res|x>nds opproprlotely when other Initiates conversotlon. 
Asks follow-up question. 
Maintains conversation. 

Expresses self-disclosures opproprlotely (stotes opinion, relates 
appropriate personal Information, e.g., "I like " etc.). 

Vertxallzes appropriate conversational closing when asked to return to work. 

15. DBMANDtDiiectOttowoiktogemer. 

Starts back from break area Imnnedkately (within 10 seconds). 

Refrains from complaining or becoming upset (no hostile/sarcastk: 
renrarks). 

Makes eye contact (kx>ks at Ad while Ad specks, glances at tasks as 
Ad presents them). 

Verbalizes understanding of task (soys "I understand," "I see," or 
repeats Instiucttons. etc.). 

Verbolizes thot he/she will do a specific task. 

Begins woik Immediately on team ossignnwnts (wtthin five seconds). 

Works steadily on tasks (does not stop to talk or rest; does not disrupt 
wort^actMty). ^ • 
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DmMd/Dm$Mor 



Ditlog/Dir9etions 



16. Ask tralMM to cfttlplz^ MCh 



To M; "Now that you've had a chance to work 
together on this task for a tew minutes, i want you 
to teii your coworker one thing he/she could do 
to improve his/her work. Don't tell me; teil 
him/her- 

(ftMt to M T^2 erHkli§ and T^2 nnt) 

To Th2: "Now i want you to name one ttiing your 
co-worker couid do to make yc jr task go batter, 
faster, or smoother. Don't teii me; teil him/her." 

(Pmim to M T^2 crHfcbt «iNf TM r§Ht) 



17. AsktioiiK>$tooompilmonf 



Make eye contact, and foce 
trainee Intttally-ttien step 
bock and k>ok of ott^er 
trainee (the one to be 
complimented). Use neutrai 
voice tone, mcrtter-o(4ioct 
manner. 



To TMs "Now I'd like you to k>ok ot your co- 
worker over there, and tell him/her directty one 
thing you reolly tike about how he/she works." 
(Anm to M TM t' Si B pill l iiiia t ml T^2 mcL) 

To Th2: "Now you tell your co^rker one thing 
you really like about how he/ihe works. Again, 
don't tell me; tell him/her." 

(P$m to M Ti^ t nmf H m mt Mud r^i mcL) 



18. Observe trainees completing 
Ihe task together 

Make eye contact: use 
neutrai voice tone and 
matter-of-tact manner to give 
instruction. 

Then step bock to your 
*'desk" to simply observe. 



To both: "OK» you now have three more minutes 
untii the end of this work period. See how much 
you can get done working together during that 
time." 

(RBfnIii from »ny dMog wHh trj/ntti. W$it ihw m/mrfti 
Mor§ going on to tho noxt dom^iid or until $11 matorUlt $ro 
sorted, if sooner.) 



67 



ERIC 



8 



16. DEMAND: Ask tralRMt to crlHeize. 
RMngB 

Names at least one concrete ctiange in woik procedures. 
Makrs eye contact with K wtien gMng critlclsnn. 
Makes eye contact wtien receiving criticism. 
Nods head or says "OK." etc. to acknowledge criticism. 
Refrains from becoming upset/defensh/e. 

17. DBMANDzAiktralneMtooon^menr. 

Nomei at leoit one positive wolk behavior. 
MokH eye cor>tact wNh B when giving compliment. 
Makes eye contact when loceiving compliment. 
Soys "Thank you." 

18. DiMAND: Obsenre trainees woiking. 
Rstlngs 

Starts bock to work Immediately (within Ave seconds). 

Refrains from complaining, sarcastic remarks, or excessive questioning. 

Works steadily through entire work period (does not stop to talk or rest; 
does not disrupt work activity). 
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Demand/Demeanor 



Dialog/Directions 



19. WoffcbrMk with iup#?vffor 

Make eye contact; use 
neutral voice tone and 
matter-of-fact manner to give 
Initial instructions. 
Adopt friendly voice tone, 
relaxed manner and posture 
during "breaks." f^alntaln eye 
contact; smile. 



Dismiss the ttalneos 



To both: "The work period's over, and It's time for 
a short break. Why don't you go over and sit In 
the break area for a few minutes?" 
(Mhw tii9m both to got up and ttart toward break area.) 

To TM: "Before you take a break. 

. i'd like to see you a 

moment. (Let Tr lgo on) Have a seat. 1 really 
haven't hod a chance to visit with you since you 
come to work for us. How is everything going?" 

(Ask ono or two $oclaliilng questions, e.g., lHhoro k your homo 
town? 00 you sf/K ha¥0 family thoro? Do you Aava a family?! 

(Frotont TrJ with 15 sccontfs of i //tflCt— iw dialog unless 
he/she Initiates It, In which ease you respond accordingly.) 

OK.__ . thanks for visiting 

with me (pause). Have a seat over In the break 
area now. if you will, until 1 call you.'* 

(Limit segment wHh Tr-l to four minute maximum. Quickly 
rate Tr-l before calling Ir-l. U$e separate sheet for quality 
componenU.See page 10.) 

, would you 



To T^2! " — 

come over here for a few minuteo, please? (pause) 
Have a seat, won't you? I just wanted to get 
acquotnted with you a little bit since you're a new 
employee. How is everything going?" 

(Ask one or two soelalMng tfuestlons, e.g., IMhat do you like 
to do In your spare time? What are your hobbies? Do you like 
sports?"* 

(Present Jr-l with IS seconds ofsilencc-no dialog unless 
he/she Initiates It, In which case you respond accordingly." 

"OK. . thanks for visiting 

with me (pause). Why don't you go back over to 
the break area for Just a few minutes?'* 
(Limit segment with Ir-l to four minute majiimum. Quickly 
rate Jr-l before closing the unit Use separate sheet for 
qualify components.^See page 10,) 

To both; "That will be all for today. You con step 
out of your role as a new employee. You can 
now return to your training area. Thanks for 
coming. We'll see you bock here at 

tomorrow." (or) 'is is 

the last day we need you to do this." 
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19. DEMAND: Woifcbmok wHh tup^ivlMr. 

Responds appropriately vyhen Ad Initiates conver$atlon. 

Maintains conversation wItt) Ad. 

Looks at Ad wtille Ad Is speaking. 

When presented wltti silence, asks an opening question. 

Asks follow-up question. 

Maintains conversation. 

Expresses self-dlsclocures appropriately (states opinions, likes, 
or dislikes). 

Verbalizes appropriate conversational closing. 
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Quality Components: Wcrkbreak 



Directions: indicate whether Trainee 1 (TM) orTralnee2 (^2) exhibit any of the foliowing 
behcMors. Rate thoir perfomnance during the work break segments by placing a check mark 
next to each behavdor performed. Do no* chook any behcMors that am not performed. 



14. DEMAND: Work Break wHh Co-worker TM Tr*2 
Quality Components 

Pleasing voice tone and volume. 

Appropriate eye contact. 

Appropriate posture. 

Positive emotional tone. 

Expresses enthusiasm through facial expressions and gestures. 

Appropriate dress. 

Acceptable personal hygiene. 



19. DEMAND: Work Break wHh Supenflsor. Thi Tr-2 
Quality Componants 

Pleasing voice tone and volume. 

Appropriate eye contact. 

Appropriate posture. 

Positive emotional tone. 

Expresses enthusiasm through facial expressions and gestures. 

Appropriate dress. 

Acceptable personal hygiene. 
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Reordering Information 

UJPfl Script & Rating form Booklet (Pkg. of 50) 
43-1382 $10.00 

UJork Perfbrmoncc ftsscssment Monuol 
43-1.375 $ 5.00 




flrkonsQS Research 6k Training Center 
In VocQtlonol Rehobilitotion 



Pub<.:Qdons Department 

Post Office Box 1358 • Hot Springs. flrt<onsQS 71902 



(501)624-4411 
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